Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ci] Assert some tests are not skipped in the CI #12915

Merged
merged 1 commit into from
Nov 13, 2022

Conversation

gigiblender
Copy link
Contributor

@gigiblender gigiblender commented Sep 27, 2022

In this PR, the skipped tests script will also check if tests in the required_tests_to_run.json have not been skipped. If there are skipped tests, they will be added to the returned comment.

I am not entirely sure where it's best to place the required_tests_to_run file, so I left it in tvm/ci/scripts/. I am happy to take suggestions.

Aims to prevent situations such as #12529

@gigiblender gigiblender changed the title [ci] Assert some tests are not skipped in the CI. [ci] Assert some tests are not skipped in the CI Sep 27, 2022
@gigiblender gigiblender force-pushed the assert-no-tests-skipped branch 3 times, most recently from 9647d80 to e010e84 Compare September 27, 2022 16:43
@areusch areusch added needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it and removed needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it labels Oct 19, 2022
@gigiblender gigiblender force-pushed the assert-no-tests-skipped branch 2 times, most recently from b5bb4f1 to b1eb3bb Compare November 3, 2022 08:31
@tvm-bot
Copy link
Collaborator

tvm-bot commented Nov 3, 2022

Thanks for contributing to TVM! Please refer to the contributing guidelines https://tvm.apache.org/docs/contribute/ for useful information and tips. Please request code reviews from Reviewers by @-ing them in a comment.

  • Built docs for commit b1eb3bb can be found here.
  • This PR had no significant effect on CI runtime: -10.39% (172.14m -> 154.24m)

Generated by tvm-bot

@gigiblender
Copy link
Contributor Author

cc @driazati @areusch for review

Copy link
Member

@driazati driazati left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know if we need to do this right away but ideally this would be part of the singular tvm-bot comment that is generated by tlc-pack/ci#52 eventually

ci/scripts/github_skipped_tests_comment.py Outdated Show resolved Hide resolved
ci/scripts/github_skipped_tests_comment.py Outdated Show resolved Hide resolved
ci/scripts/github_skipped_tests_comment.py Outdated Show resolved Hide resolved
tests/python/ci/test_ci.py Outdated Show resolved Hide resolved
…required_tests_to_run` file are not skipped.
@driazati driazati merged commit b8384d1 into apache:main Nov 13, 2022
@gigiblender gigiblender deleted the assert-no-tests-skipped branch November 13, 2022 07:03
xinetzone pushed a commit to daobook/tvm that referenced this pull request Nov 25, 2022
In this PR, the skipped tests script will also check if tests in the `required_tests_to_run.json` have not been skipped. If there are skipped tests, they will be added to the returned comment. 

I am not entirely sure where it's best to place the `required_tests_to_run` file, so I left it in `tvm/ci/scripts/`. I am happy to take suggestions.

Aims to prevent situations such as apache#12529
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants